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0.  Abstract 

An  intelligmt  motion  surface  consisting  of  an  array  of  micro-robots  has  been  designed  and  simu¬ 
lated  for  use  in  applications  requiring  the  manipulation  of  parts  for  micro  and  precision  assembly. 
The  array  was  designed  for  implementation  in  Micro-Electro-Mechaiucal  Systems  (MEMS)  tech¬ 
nology.  A  iqiedfic  form  of  micro-robot,  called  a  LAMBDA  machine,  was  used  in  the  initial 
design.  Individual  micro-robots,  initially  without  sensing,  can  be  programmed  so  that  the  ensem¬ 
ble  can  operate  in  a  variety  of  modes,  called  gaits.  These  gaits,  some  of  than  explored  in  the 
papa,  have  differmt  lifting  and  translatory  propoties  and  can  be  chosen  for  best  effect  in  a  par¬ 
ticular  situatitHi.  The  array  can  be  opoated  in  various  gaits  to  impart  distributed  vector  forces  to  a 
part  placed  on  the  array.  Groups  of  contiguous  micro-robots  executing  identical  but  phase  shifted 
motions  have  tiie  effect  of  imparting  a  qratially  defii^  force  field  on  a  part  or  set  of  parts,  placed 
on  the  group.  The  appropriate  choice  of  force  fields  in  shape,  spatial  extent  and  vector  direction  is 
shown  to  cause  parts  to  be  moved  in  manners  thiu  ate  useful  and  appropriate  to  assonbly  opoa- 
tion  such  as  translation,  rotation,  orientation,  aligning  and  filtering  based  on  part  shape. 

In  the  first  stage  of  the  study,  described  hoe,  a  simulator  was  built  to  explore  the  practicability  of 
programming  a  miniatore  assembly  bendi  constructed  by  the  silicon  micromachining  of  such  an 
array  of  mioo-tobots.  The  simulatimt  allowed  the  oitry  of  the  shape  and  form  of  the  force  fields, 
the  shape  of  the  parts  or  parts  to  be  moved  and  the  interactive  placement  of  the  nart  on  the  field 
for  the  subsequoit  motioiLThe  simulation  used  simple  physical  models  of  tiie  forces  contributed 
by  each  micro-robot  Both  image  and  graphics  based  modelling  techniques  were  explored  for 
^eed:  gnq)hics  based  simulation  is  superior  especially  when  multiple  parte  are  involved. 

The  results  of  experimoits  on  primitive  assembly  opemtions,  limitations  of  the  approach,  exten¬ 
sions  and  possibilities  for  future  work  are  discussed. 


1.  Introductioii 


The  goal  of  the  woik  described  here  is  to  exploie  the  methods  of  use  and  limitations  of  a  bed  of  a 
large  number  of  small  manipulator  arms  in  moving,  orienting  and  holding  micro-objects;  that  is, 
the  use  of  arrays  of  micromanipulators  as  a  miniature  assembly  bench.  Hie  application  domain 
includes  die  assembly  of  multi-chip  modules  (MCM),  opto-electronic  integrated  circuits  (OEIC) 
and  implantable  medical  devices,  etc.  It  is  expected  that  assembly  using  this  method  will  show  an 
increase  in  throughput  and  in  the  quality  of  the  product  compared  to  the  current  human  assembly 
techniques  which  are  fraught  with  difficulty  at  small  geometric  scale;  today,  chips  used  in 
MCM’s  are  first  loaded  in  particular  orientation  visually  and  then  placed  in  the  correct  location  by 
pick-and-place  machines.  The  intelligent  motion  surface  has  the  potential  to  replace  the  tradi¬ 
tional  visual  recogiution  system  by  its  intrinsic  design.  Meanwhile,  unlike  the  traditional  method, 
the  Intelligent  Motion  Surface  can  orient  and  align  the  component  parts  in  parallel  to  speed  up  the 
assembly  work.  On  the  other  hand,  however,  the  miniature  mechanism  is  hard  to  implement;  ordy 
a  few  degrees  of  freedom  may  be  possible  in  the  real  design  of  the  micro-robot  Several  factors 
need  to  be  considered  in  the  overall  system  design,  these  include  the  structure  of  the  unit  robot 
the  ^tial  arrangement  of  an  array  of  them,  the  system  control  modes,  and  assembly  scheduling 
schemes. 

In  the  literature,  previous  work  includes  papers  on  the  design  of  the  unit  manipulators,  [IBM93] 
[PISTER90]  [PIS1ER92],  papers  on  the  theory  in  orienting  parts  without  sensing 
[GOLDBERG93]  and  the  theory  of  manipulation  and  control  for  micro-actuator  arrays 
[BOHRINGER94]  respectively.  The  interest  here  is  in  exploring  the  feasibility  and  limits  of  the 
ideas  necessary  for  building  Ae  micro-system,  the  trade-off  between  sensory  and  inert  arrays, 
their  communication  and  control  needs,  their  gait  manners  to  drive  a  part  forward  and  the  imple¬ 
mentation  of  an  integrated  system. 

The  micro-robot  assembly  system  will  be  implemented  on  VLSI  wafers.  The  micro-robot  config¬ 
uration  chosen  for  the  current  study,  the  LAMDA  machine,  is  a  four  bar  linkage  micro-manipula¬ 
tor.  Each  robot  applies  a  force  to  the  part  in  contact  with  its  tip.  The  unit  marupulator  can  be  used 
to  populate  a  two  dimensional  array  in  a  variety  of  configurations  and,  therefore,  generate  differ¬ 
ent  force  fields.  Each  robot  can  be  controlled  in  different  modes  to  perform  motion.  For  an  array 
of  robots,  the  individual  robots  can  move  either  synchronously  or  asynchronously  to  achieve 
ways  to  translate  a  part  on  the  array.  The  surface  of  the  array  may  become  “intelligent’  when  the 
control  system  is  installed  so  that  the  operations  of  the  unit  manipulators  ate  programmable;  i.e. 
the  various  force  fields  supply  the  ability  to  perform  different  functions  to  translate,  rotate,  or  sort 
parts  to  destination  positions  for  the  assonbly  purpose.  The  assembly  jobs  can  be  scheduled  by 
calling  sequences  of  basic  functions. 

The  array  was  studied  first  in  simulation.  In  the  simulation  approach,  a  simple  user  interface  has 
been  implemented  in  the  X- Window  environment  It  supports  the  ability  to  dynamically  change 
configurations  of  the  force  fields  generated  by  its  simple  micro-manipulators.  Users  can  also  define 
parts  in  arbitrary  shapes  and  locate  them  on  the  field  array.  The  simulator  will  then  display  the 
translations  and  rotations  of  the  parts  within  the  fields. 

The  simulation  was  designed  to  show  the  basic  concepts  from  the  micro-robotic  operations  to  the 
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overall  system  mechanism.  Several  experiments  were  designed  including  the  centering,  aligning 
and  ginning  of  parts,  the  motion  in  a  convergent  or  a  divergent  field  array,  and  the  programmable 
field  array  to  perform  assembly. 

The  paper  is  arranged  as  follows.  Section  2  introduces  the  concepts  of  tl»  design  of  both  unit 
manipulator  and  planar  manipulators.  The  us^  interface,  simulation  models  and  procedures  ate 
introduced  in  section  3.  The  sets  of  experiments  and  results  are  described  in  section  4.  Section  S 
contains  the  conclusions  and  plans  for  the  future  study. 


2.  The  Concepts  of  Unit  Manipulator  and  Array  of  Manipulators 
2.1).  Unit  manipulator 

The  mechanism  studied  in  most  detail  so  far  in  the  work  described  here,  is  the  simple  4-bar  link¬ 
age  X  (LAMBDA)  machine  in  Hgure.l.  This  shows  a  manipulator  cell,  pin  jointed,  with  the  main 
beam  inclined  at  some  angle  to  the  right  of  the  vertical  with  two  motors  driving  the  base  joints. 
Under  control  of  the  base  motors,  the  tip  of  the  manipulator  can  be  designed  to  op^te  in  rela¬ 
tively  high  left  to  right  motion  followed  by  a  relatively  lower  right  to  left  motion  and  thus  to  make 
a  loop  motion  in  ^)ace  that  urill  be  defined  as  an  R-motion. 


2.2).  Gaits  of  Array  of  Manipulators 

The  operatimi  of  an  array  of  micro-robots  on  moving  a  part  placed  on  its  surface  can  be  illustrated 
using  a  linear  array  of  such  manipulators  operating  in  the  same  directioiL  The  control  of  individ¬ 
ual  micro-robots  may  be  synchronous  or  asynchronous. 

2.2.1).  Synchronous  Operations 

An  object  placed  on  the  one  dimensional  array  of  manipulators  shown  in  Figure  2,  each  of  which 
is  executing  an  R-motion,  will  move,  undn  suitable  conditions,  to  the  tight  A  plausible  explana¬ 
tion  is  that  if  the  motion  is  executed  at  a  high  speed  relative  to  the  effective  time  constant  of  the 
mass,  the  inclined  angle  of  the  main  beam  wall  cause  the  tip  to  tend  to  slip  on  the  leftward  motion 
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and  to  “dig  into”  die  object  on  the  rightward  motion  and  push  the  carried  object  to  the  right,  heiKe 
the  term  R-motion.  An  alternative  way  of  looking  at  the  operation  of  the  array  is  to  note  that  there 
is  a  differential  friction  between  the  two  directions  of  motion  of  the  base  manipulators  relative  to 
the  object  and  this  impresses  different  forces  on  the  object  in  the  two  directions.  V/lthin  con- 
^raints  to  be  detnmined  and  simulated,  the  array  wUl  support  the  object  without  being  crushed  or 
ovopowered  and  fail  to  operate.  An  array  of  manipulators  using  a  unit  cell  in  the  form  of  a  mirror 
image  of  the  R-man4>ulator  would  move  parts  to  tte  left,  i.e.  execute  an  L^motion. 

However,  it  may  turn  out  on  close  examination,  that  the  difference  in  friction  in  the  two  motion 
directions  is  insufficient  to  drive  the  part  forward.  In  that  case,  it  might  be  better  to  use  a  second 
mode  of  control  in  which  the  drive  array  for  a  single  direction  is  broken  up  into  two  interleaved 
sets,  the  odd  and  the  even  manipulators  in  order  to  achieve  more  positive  control  of  the  forces 
lyiplied  to  the  part  being  carried.  This  motivated  examination  of  the  following  two  asynchronous 
modes  of  operation. 


Slaw forward /large  friction 


" 

Fast  backward /dightfrictioH 


Net 

Force 


KKKK 


Figure  2.  Single-Phase  Gait 


2.2.2).  Asynchronous  Operations 

The  idea  of  the  asynchronous  operation  is  that  the  odd  and  even  manipulators  hold  and  drive  the 
part  alternately.  This  mode  of  motion,  a  type  of  the  general  idea  called  “gait”  in  robotics  litera¬ 
ture,  was  used  intrinsically  by  Fujita[FUJITA93]  in  his  experiments  and  by  Bohringer 
[BOHRINGER94].  Gaits  need  not  be  strictly  interleaved  but  may  have  random  phase  or  a  patt^ 
suited  to  the  part  being  carried.  Various  one-  and  two-dimensional  random  gaits  can  be  explored 
in  simulation.  Some  manipulators  can  be  used  in  supporting  the  parts  while  some  of  the  manipula¬ 
tors  retract  and  others  drive  forward.  Each  motor  in  the  array  nwds  to  be  under  individual  control 
in  ordtf  to  achieve  maximum  manipulation  flexibility.  First,  the  even  set  could  be  used  to  support 
die  object  while  the  odd  set  moves  to  the  1^-most  position  to  execute  the  up  and  to  the  right 
motion,  thus  moving  the  supported  object  one  unit  to  the  right  At  this  point  the  sets  change  func¬ 
tion  and  the  odd  set  supports  and  the  even  set  drives  the  object  one  unit  to  the  right  Continuing 
this  mode  of  operation  causes  the  supported  module  to  continue  to  traverse  to  the  right  Figure  3 
and  Figure  4  illustrate  two  methods  of  die  control  of  the  base  motors.  Both  the  control  modes  can 
be  used  for  the  asynchronous  gaits.  Hgure  5  shows  snapshots  of  animation  of  these  two  gaits. 

A  4-phase  pushing-forward  motion  is  shown  in  shown  in  Figure  3.  The  tip  of  the  manipulator  can 
be  d^gned  to  make  a  motion  to  move  from  left  to  right  in  a  relatively  up  position,  move  down, 
and  then  move  right  to  left  in  an  down  position,  move  up  and  repeat  the  motion  in  a  closed  curve 


in  the  plane  of  the  mechanism.  This  mode  of  motion  is  a  Right  or  R-motion.  Its  reflection  gives  an 
L-motion.  The  other  approach,  called  3-phase  lifdng-up  motion  and  shown  in  Figure  4,  moves  the 
tip  to  the  center  in  an  up  position,  retracts  the  left  arm  in  a  relatively  low  position  and  then  retracts 
the  right  arm  to  a  down  position  and,  similaily,  repeats  in  a  closed  curve.  Ihe  motion,  on  the  other 
hand,  generates  a  Left  motion  or  L-motion.  Simil^y,  its  reflection  gives  an  R-motion. 


Hgure  4. 3-Phase  L-Motion 


(a).  3-Hiase  Lifting-Up  Design 


(b).  4-Phase  Pudi-Forward  Design 


Figure  5.  Animation  of  the  translations 

The  3-phase  “lifting-up”  primitive  can  translate  any  object  efficiently,  no  matter  if  the  tip  of  the 
manipulator  is  rough  oiough  to  push  the  object  In  other  words,  the  friction  coefficient  betwera  the 
tip  of  the  robot  and  the  surface  of  the  part  is  not  a  significant  factor  for  the  motion.  The  throw  and 
efficiency  of  the  translation  are  sensitive  to  the  length  of  the  two  arms  of  the  manipulator,  and  die 
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difference  of  the  operation  between  the  neighbor  robots.  Figure  6  illustrates  the  effects  of 
changing  the  phase  anglp.  between  the  motion  drives  of  adjacent  LAMBDA  machines  and  changing 
the  LAMBDA  arm  length.  The  net  throw  and  the  duty  cycles  of  a  pair  of  adjacent  robots  can  be  • 

observed  in  Figure  6.  (b)  which  shows  the  y-motions  of  the  tips  of  two  adjacent  robots  and  x- 
motions  of  the  translated  part  respectively. 


*Vartablc«:(l).  Am  Laogth  Ratio:  55:50  &100:50  oGrld  Size:  5*5  (Unh  Dtetanoe^ 

(2).  PhoM  DiffereaoM:  0*  - 180* 

(a).  The  Tracks  of  the  Motion  of  the  Part  in  4  Cycles  of  Operation 


# 
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(b).  The  thacks  in  thiee  various  phase  differences. 
Figure  6.  The  Motion  of  the  3-Phase  Gait  Primitive 


The  closed  corves  labelled  0  degrees  in  Figure  6  (a),  show  that  if  all  the  LAMBDAs  are  operated 
synchronously,  the  part  will  not  translate  on  the  surface.  At  30  degrees  the  part  slowly  drifts 
forward  while  making  larger  oscillatory  excursions,  while  at  180  degrees  the  part  moves  forward 
smoothly.  Tables  1  and  2  list  some  of  tte  experimental  results. 

Thble  1:  The  Speed  and  ECBdem^  of  the  3-phase  Gait  (1). 
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11.05% 
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55.69% 
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61 
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3.60 

3.60 

7.56 
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26.35% 
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liible  2:  Hie  Speed  and  Efficiency  of  the  3-phase  Gait  (2).  (<|>  is  180^.) 
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In  the  tables,  4>  is  the  phase  difference  (in  degree)  of  the  operations  between  two  neighbor  robots. 
Since  a  robot  is  operated  in  phase  difference  4>  ahead  of  a  neighbor  one  is  the  same  as  360°-4 

behind  of  the  neighbor,  the  phase  difference  is  considered  from  0°  to  ISO**.  The  max_throw  is  the 
maximal  displacement  of  the  tip  of  the  elementary  robot  in  each  cycle  of  operation.  The  speed  is 
the  throw  of  the  part  in  each  cycle.  The  efficiency  is  the  speed  divided  by  2*max_thrDW,  because 
the  part  can  be  translated  at  most  2  times  of  the  max_throw  in  each  cycle. 

Given  the  fixed  lengths  of  the  two  arms,  the  speed  of  the  gait  monotonically  increases  as  the  phase 

difference  increases  up  to  180°.  In  table  2,  when  the  phase  difference  is  fixed  at  180°,  the  speed 
increases  as  the  length  ratio  of  left  arm  to  right  arm  b^omes  larger.  But  the  efficiency,  on  the  con¬ 
trary,  monotonically  decreases  due  to  the  larger  maximal  throw.  When  the  lengths  of  the  arms  are 

equal,  and  <|>  is  180^,  the  efficiency  is  almost  100%. 

The  efficiency  of  the  4-phase  **pushing-forward”  primitive,  on  the  other  hand,  is  only  slightly 
affected  by  the  length  of  the  longer  arm  of  the  manipulator;  the  part  is  simply  translated  by  half  of 
the  motor  excursion  per  cycle.  The  best  efficiency  can  be  acquired  whra  die  neighbor  robots  are 
operated  in  opposite  phas^.UnlilDe  the  operation  of  the  3-phase  design,  it  is  easy  to  opiate  two 
robots  in  180°  phase  differmce  to  maximize  the  throw.  The  disadvantage  of  the  design  is  that  the 
maximum  throw  is  limited  by  the  motor  excursion  no  matter  how  large  the  difference  of  the  arms. 

For  both  of  the  gait  designs,  there  exists  a  greater  force  at  the  tip  and  a  bettor  stiffness  of  the  arm 
if  the  length  difference  is  small.  Bodi  of  the  designs  can  have  optimal  efficiency  when  the  lengdi 
difference  is  minimized.  Hie  throws  of  the  two  designs  are  about  equal  when  the  phase  is  180°. 
However,  it  is  hard  to  make  the  180^  phase  difference  which  is  1.5  periods  of  one  operation  state. 
If  the  120°  phase  differoice,  which  is  easy  to  be  generated  for  3-phase  design,  is  considered,  the 
throw  of  the  3-phase  design  in  each  cycle  is  larger  than  the  4-phase  design  when  its  length  ratio  of 
the  two  arms  is  larger  than  5:2.  (Refer  to  table  1  in  the  row  of  125:50).  If  the  stiffiiess  of  the  longer 
arm  would  not  cause  any  problem,  then  the  three-phase  design  will  have  larger  throw  when  the 
length  ratio  of  the  arms  is  increased. 
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2.23).  Planar  Man4>ulators 


The  unit  manipulator  can  be  used  to  populate  a  two  dimensional  array  in  a  variety  of  configura¬ 
tions.  The  array  of  manipulators  essentially  creates  a  force  field,  which  is  utilized  to  perform  dif¬ 
ferent  operations  on  a  part.  In  the  remaining  sections  of  the  pq)er,  the  study  concentrated  on  the 
force  models  of  the  array  of  planar  manipulators,  the  stability  condition  of  the  oriented  part,  and  a 
simulation  ^tptoach  to  show  the  translation  and  rotation  of  the  part  located  in  the  force  field. 


3.  The  Impleiiientation  of  tiie  Simulator 

3.1)  User  Interface 

A  user  interface  for  the  simulation  system  was  implemented  in  the  C  language  and  using  the  X 
library  routines  associated  with  the  X  Open  Look  tool  Idt  on  the  Sun  workstation  envirotunent 
pCWn^  The  user  is  ^ven  the  ability  to  create  a  polygonal  region  on  the  surface  of  the  array  and 
label  it  with  a  force  directioiL  The  force  directions  have  been  arbitrarily  chosen  to  be  positive  and 
negative  X  and  positive  and  negative  Y.  Other  directions  are  clearly  possible.  In  the  simulations 
described  hoe,  different  force  fields  (labelled  north,  south,  east,  and  west)  are  labeled  with 
different  textures  (surface  patterns  with  color  badcgrounds  and  arrows  in  four  directions).  Us^ 
can  define  force  fields  in  terms  of  the  polygon-shaped  areas  on  the  main  canvas  of  the  interface.  In 
the  main  canvas  of  the  user  interfux,  each  image  pixel  represents  a  unit  manipulator  and  the  square 
field  area  is  the  active  region  of  two-dimensional  array  of  the  manipulators.  Overliqpping  of  the 
drawing  of  the  fields  is  allowed  in  the  grapMcs  user  interface,  but  only  the  topmost  field  sluqte 
(which  is  also  the  only  visible  region  of  the  overlapped  set)  is  used  to  c  ompute  the  contribution  to 
the  forces.  Parts  ate  defined  in  another  specific  canvas  using  the  similar  drawing  scheme.  In  this 
canvas,  objects  can  be  edited  if  requited.  After  tl^  editing  of  the  object  is  finished,  it  is  located  in 
the  field  array  on  the  main  canvas.  The  location  is  arbitrary;  the  user  can  drag,  drop  and  rotate  the 
part  manually  to  the  proper  positiotL  Then,  the  translation  of  the  object  is  performed  step  by  step 
in  this  array. 


Menubar  _^| 
Main.Qam^ 


Held  Legend 


library 

Menu 


Figure?.  User  Interface 


Object 
Canvas 

Part  in  the  field 
array 
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The  technique  of  plane  oveilay  in  the  computer  graphics  was  introduced  in  the  animation;  it  is  an 
efficient  approach  to  translate  a  part  on  the  area  without  destroying  the  texture  of  the  background 
fidds.[XWIN]  The  field  arrays  and  the  parts  defined  by  users  can  be  stored  Users  can  down  load 
than  and  make  any  combination  for  different  requirements.  Hgure  7  shows  the  user  interface,  the 
arrows  show  die  direction  of  the  force  fields. 


3.2)  Force  Model:  A  Static  Analysis 

A  static  analysis  is  applied  to  the  current  modeL  The  later  models  will  use  rigid  body  dynamics. 

The  following  assumptions  are  made  for  the  modeling  process:  The  unit  robot  imparts  a  force  to 

the  carried  object 

a.  The  unit  robot  imparts  a  force  to  the  carried  object 

b.  The  mass  of  the  part  is  uniformly  distributed;  each  micro-robot  holding  the  part  give  the  same 
force  contribution  to  it 

c.  The  object  is  translated  and  rotated  in  discrete  fashion;  the  elementary  manipulators,  at  most 
move  die  part  for  1  unit  step  and/or  rotate  it  for  1  unit  angle  in  each  cycle. 

d.  The  initial  and  final  velocity  in  each  micro-cycle  are  both  zero;  there  is  no  momentum  of  the 
part 

e.  The  intersections  of  each  field  and  the  object  placed  on  the  field  array  conceptually  separate  the 
object  into  several  sub-regions  with  each  region  generating  a  net  force  and  a  net  torque  with 
respect  to  the  center  of  gravity  of  the  object  The  object  is  stable  when  the  summations  of  both 
the  net  forces  and  net  torques  contributed  by  all  object/field  intersections  are  zero. 

The  distributed  forces,  based  on  the  above  assumptions,  resulting  from  die  manipulators  are 

summed  up  cell  by  cell  for  all  micrD-robots  holding  die  part  Hie  torque  with  respect  to  the  center 

of  mass  of  the  part  is  similarly  computed.  Equations  1  and  2  list  the  basic  formulas. 


A 

X  = 


(Equation  1) 


(Equation  2) 


*  where  F  is  die  vector  of  total  force,  /;  is  the  indi vidual  force  vector  contributed 
by  the  mampolator  I. 

*  T  is  the  vector  of  total  torque  of  the  pari,  (on  I  die  vector  from  mass  center 
to  the  manipulator  t. 

Given  the  net  force  and  torque  gei^rated  by  the  force  field,  the  motion  can  be  described  and 
measured  as  follows. 
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(F=nui).(x  =  la)  (Equations) 

fa  =  VQxr  +  ixaxt^^^G  =  tOQXt  +  ^xax/^  (Equation  4) 

Motion  in  the  physical  world  will  be  veiy  complex  due  to  a  variety  of  effects  including  chip  surface 
roughness  and  force  available  from  the  micro-robots  and  the  model  may  be  different  when  other 
elmnentary  micro-manipulators  are  used.  A  mote  precise,  physically  rei^tic,  model  may  need  to 
wait  for  expoimental  experience  for  validation  and  understanding. 

A  simplified  motion  model  is  used  here.  Two  thresholds  ate  set  proportionally  to  the  mass  and  die 
moment  of  inertia  of  the  part  for  the  force  and  torque  respectively  for  simuladon  convenience. 

If  the  total  force  exceeds  the  force  threshold,  the  part  will  be  moved  for  one  unit  distance  along  die 
dominant  directioiL  Similarly,  if  the  total  torque  exceeds  the  torque  threshold,  the  part  will  spin  for 
one  unit  angle. 


3.3).  Simulation  Approach 

Thoe  is  trade-ofif  between  accuracy  and  speed  of  the  simulation;  two  different  levels  of  details  of 
the  simulation  have  beoi  designed;  they  perform  image  level  and  graphics  level  simulation 
respectively. 

3.3.1)  Image  Level  Simulation 

In  the  image  level  simulation,  under  the  assumption  of  the  force  modds  in  section  3.2),  the 
distributed  forces  and  torques  resulting  from  the  manipulators  are  summed  up  pixel  by  pixel  by 
detecting  the  ovetUq)ped  region  and  the  textures  of  the  field  array  and  the  part 

The  image  processing  function  calls  ate  available  in  the  X  window  system.  The  polygon  fields  ate 
defined  and  miq)ped  to  the  main  canvas,  the  part  is  also  defined  and  overlaid  to  the  main  canvas. 
The  ovoiaid  region  in  die  canvas  rqnesents  the  active  region  of  the  force  field  array  that  will  affect 
the  motion  of  die  part  The  bit  patterns  of  the  pixels  in  the  superposed  region  give  a  way  to  detect 
the  siqierposition  and  recognize  die  direction  of  the  field  vector  so  that  the  total  force  and  total 
torque  can  be  calculated  pixel  by  pixel  Hgure  8  shows  the  subroutine  for  the  purpose.  The 
advantage  of  the  Systran  function  calls  is  the  convenience  that  the  programmras  do  not  have  to  deal 
with  the  flood/boundary  fill-in  algorithms  for  the  polygons  fields  and  parts  in  the  paradigm  of  high 
level  language.  The  disadvantage  is  the  fact  that  the  screen  image  access  speed  is  by  no  means 
satisfactory  as  the  workload  increases;  a  lot  of  redundancy  in  the  image  processing  could  be 
avoided  by  means  of  computational  geometry  methods. 


Di  most  motions,  only  the  pixels  around  the  contour  of  die  part  will  change  between  iterations. 
Nevotheless,  the  change  is  hard  to  detect  especially  when  the  shape  of  the  part  is  very  complex. 
This  makes  graphically  based  simulation  preferable. 


3.3.2)  Grq)hics  Level  Simulation 

A  graphics  level  altonative  was  developed  to  reduce  the  computational  workload.  The  model  is 
based  on  computational  geometry  schemes  including  polygon  decomposition,  polygon  clipping 
[SUTHERLAND74],  and  polygon  ttiangulation  algorithms.  The  polygon  shaped  fields  are 
decomposed  into  a  convex  set  L  The  decomposed  convex  polygons  thmi  behave  like  windows  to 
clip  the  “visible**  portions  of  the  part  The  portions  of  the  part  are  then  triangulated  in  order  to 
estimate  the  force  and  torque  contribution  individually.  (Refer  to  Figure  9.) 

Triangulating  the  portions  of  die  part  is  used  because  the  mass  center  of  die  triangles  can  be  derived 
directly  by  measuring  the  intersection  of  two  segments  si  and  s2  in  Hgure  9(c).  Each  of  them  is 
the  connection  betwemi  one  vertex  of  die  triangle  and  the  medium  point  of  the  opposite  edge. 
Equatitm  S  and  6  are  the  formulas  for  calculating  total  force  and  torque  in  the  graphics  level 
simulation.  Hguie  10  shows  the  accumulation  of  the  total  force  and  torque  contribute  by  each 
triangulated  sub-region  of  the  object/field  intersection. 
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(c).  Part  Triangulation 


(b).  Part  Clipping 


(d).  Clipping  Example 


Hguie  9.  (a).  Polygon  Decompositioru  (b).  Polygon  Clipping, 
(c).  Polygon  Triangulation  (d).  Clipping  Example. 


>ftriangle$ 

=  X  ^triangle{0 

y/trkmgUt 


(Equation  5) 
(Equation  6) 


*  wboe  F  is  die  vector  total  fo(ce,>J  U  die  unit  force  vector 

oi  die  triangubied  region  t 

*  T  is  die  vector  of  total  torque  of  die  part. /cMLflHf  0*8  the  vector 

from  mass  center  of  die  wtele  part  to  the  mass  center  of  the  triangulated 
region  L 
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Hguie  10.  Graphics  Level  Calculation 


The  graphics  level  simulation  is  much  more  efficient  but  less  flexible;  it  increases  the  speed  for 
calculation  in  the  simulation,  but,  when  a  more  sophisticated  analysis  is  required,  say,  the  realistic 
friction  force  in  each  marupulator  is  considered,  the  force  model  will  become  mote  complicated 
and  the  computation  in  the  graphics  level  simulation  may  need  revision. 

3.4).  General  Notes  on  Stability 

The  general  stability  property  for  a  simple  arrangement  of  motion  cell  is  tiiat  the  area  of  the  part 
on  each  side  of  the  boundary  should  be  equal  and  that  the  line  joining  the  centroids  of  the  areas  of 
the  part  on  eitiim*  side  of  the  line  of  demarcation  of  the  motion  domains  should  be  perpendicular  to 
that  line,  Le.,  force  and  torque  should  be  zero.  For  more  complicated  configuration  of  the  field 
array,  it  is  obvious  from  Equation  5  and  6  that  the  stable  concfition  exists  when  the  areas  of  the 
fields  imparting  forces  in  opposite  directions  ate  equal  and  also  the  net  torque  of  the  cross  product 
terms  of  each  triangulated  region  in  equation  6  is  zero. 


4.  Experiments  and  Results 

Sevoal  experiments  useful  in  micro  assembly  were  designed  and  executed  on  the  simulatiotL  The 
pictures  illustrate  the  operations  of  the  experiments. 
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1).  Cetering  a  part  until  stable. 
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Figure  1 1.  Centering  Parts  till  Stable 


In  Figure  11,  any  part  of  suitable  size  placed  anywhere  on  uniform  motion  part  of  the  plane  (say 
all  Up  or  all  Down)  translates  until  an  edge  crosses  a  boundary  into  a  different  motion  domain.  At 
this  point  the  motion  is  a  combination  of  translation  and  rotation  until  the  part  migrates  so  that  the 
center  of  the  supported  area  (Le.,  the  simply  or  multiply  connected  area  in  contact  with  the  micro¬ 
manipulators)  sits  on  the  boundary  of  the  Up  and  Down-motion  areas.  The  general  stability  prop¬ 
erty  for  this  arrangement  of  motion  cells  is  that  tli«  area  of  the  part  on  each  side  of  the  boundary  is 
equal  and  that  the  line  joining  the  centroids  of  the  areas  of  the  part  on  either  side  of  the  line  of 
demarcation  of  the  motion  domains  is  perpendicular  to  that  line,  i.e.,  net  force  and  torque  are  zero. 


2).  Spiraling  or  Rotating  a  part 


Figure  12.  Spiraling  a  part  to  center 


Three  geometric  patterns  of  U  and  D-motion  fields  will  spiral  or  rotate  a  part  in  different 
fashions. 


a.  Spiraling  a  part  to  center  in  a  convergent  field  array.  (Hgure  12) 

The  whirlpool- shaped  field  array  is  conv^gent  since  each  segment  of  the  circulated  fields 
sweq>s  die  part,  without  translation,  to  a  position  just  inside  the  next  orthogonal  field  which 
swe^  the  part  closer  toward  the  center  of  the  array. 

b.  Spiraling  a  part  away  from  the  center  in  a  divergent  field  array.  (Hgure  13) 

Hiis  configuration,  on  the  contrary,  moves  die  part  in  outward  manner.  The  center  is  a  position 
of  unstable  equilibrium.  A  part  placed  at  die  center  in  a  conditionally  stable  state  migrates  to  the 
boundary  under  slight  dist^ances. 


Hgure  13.  Spiraling  a  part  away  from  die  center 


c.  Rotating  a  part  about  the  center  in  four  triangular  fields.  (Hgure  14) 

In  the  arrangement  shown,  the  boundary  edges  and  the  field  directions  are  not  orthogonal  and 
it  is  not  obvious  if  the  rotation  is  convergent  or  divergent  Figure  14  (a),  illustrates  a  divergent 
case.  Howeva,  if  the  part  is  almost  symmetrical  and  placed  in  the  centn  of  the  array, 
experimoits  showed  that  even  when  a  very  long  term  translation  was  executed,  the  center  of 
mass  of  die  part  was  still  moved  within  a  small  cycle  among  the  cenl^  of  the  field.  (Hgure  14 
(b).)  Further  work  needs  to  be  done  to  determine  whedier  this  is  an  intrinsic  feature  or  due  to 
die  interaction  of  quantization  effects  or  due  to  the  part  shape. 
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Figure  14.  Rotating  a  part  about  the  center . 


^  3).  Spatially  filtering  a  part 

Figure  15  shows  a  a  spatial  filter.  The  area  a  can  be  made  of  type  D  orientation  and  the  two  areas 
labelled  b  and  c  of  type  R  and  L  respectively.  A  part  placed  entirely  in  the  funnel-shaped  area  a 
migrates  downward  until  it  enters  either  area  b  or  c  where  it  receives  a  force  causing  a  torque  to 
align  the  part  along  the  slanted  sides.  It  will  then  slide  down  the  side  until  it  reaches  the  ouq)ut 
#  slot  at  the  bottom  of  the  diagram.  Here  because  of  the  way  the  picture  is  drawn,  the  system  acts  in 

a  manner  reminiscent  of  the  action  of  a  fluid  under  gravity. 


before  filtering  filtering 

Rgure  15.  Spatially  filtering  a  part 

4).  Translating  a  part  in  a  complex  path.  In  Rgure  16,  a  complex  path  was  arranged  with  walls 
(using  Helds  operating  in  opposite  directions)  orthogonal  to  the  path  to  constrain  the  track  of  the 
translation. 


[ 
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S).  Orienting  a  part  in  a  programmable  field  array. 


So  far,  the  discussion  has  centered  on  arrays  that  can  be  arranged  at  compile  time,  that  is  the  force 
directions  could  be  built  into  the  silicon  as  a  single  complex  Held  array.  Instead  of  designing  a 
single  complex  field  array  to  translate  a  part,  another  perspective  is  to  make  the  array  dynamically 
progranunable.  Hgure  17  shows  the  idea  of  scheduling  (programming)  a  sequence  of  basic 
operations  to  translate  and  orient  a  part  for  assembling  purposes 


Step  1: 

Aligning  the  Part  to  a 
Vertical  Boundary 


Hgure  17.  Orienting  a  part  in  a  programmable  field  array. 
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Step  2: 


Aligning  the  Part  to  a 
Horizontal  Boundary 


Step  3: 

Rotating  the  Part  about  Its 
Center  of  Mass  for  a  Certain 
Angle 


Step  4: 

Transmitting  the  Oriented  Part 
out  of  the  Woiicbench 


Hgure  17.  (Continued)  Orienting  a  part  in  a  programmable  field  array. 


6).  Sorting  two  parts  using  a  hole 

The  idea  is  that  a  hole  may  be  used  as  a  trap  for  a  part  being  translated  past  it  Ihe  shi^  of  the  hole 
set  at  a  boundary  of  fields  should  be  geometrically  similar  and  a  little  larger  than  one  of  the  parts 
being  sorted.  A  part  moving  past  the  hole  would  fall  into  the  trap  while  another  part,  larger  than 
die  hole,  would  not  be  pofectly  overli^iped  with  die  hole  and  would  pass  by  periu^  changed  in 
direcdon  but  not  captured.  The  trapped  part  can  then  be  moved  by  rqirogramming  die  array  to 
moved  as  desired.  Thus,  two  parts  with  different  shapes  can  be  discriminated:  the  op^adons 
petfcHtn  a  sorting  function  of  the  field  array.  Notice  diat  before  tte  stage  for  matching,  trapping 
and  sorting,  the  parts  need  to  be  well  aligned  and  oriented.  Otherwise,  even  the  part  is  similar  to 
die  hole  in  shi^  it  may  not  be  tn^ped.  Figure  18  shows  the  idea. 
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Step  1:  AL'i^ning  the  two  Parts  for  Matching 


(Success) 


(Failure) 


Step  2  :Matching  and  Trapping 
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Step  3:  Discreminating 


Figure  18.  Sorting  two  parts  using  a  hole 


5.  Condusioiis  and  Future  Research 


A  simple  4-bar  linkage  X  machine  was  used  as  the  unit  manipulator.  Under  control  of  the  two  base 
motors,  with  various  combinations  of  the  motion  states  (forward,  backward,  and  still)  of  the  two 
arms  of  the  robots,  the  robots  perform  different  “gaits’*.  Two  efficient  gaits  were  shown  for  the 
translation  and  rotation  of  parts. 

A  simulation  system  with  its  associated  user  interface  has  been  designed.  Simple  incremental 
motion  modalities  were  simulated,.  The  simulation  will  be  extended  to  work  on  the  dyiuunics  of 
rigid  bodies. 

The  experiments  showed  the  basic  operations  of  the  miniature  work  bench.  A  sensoiiess  micro¬ 
manipulator  system,  as  demonstrated  above,  can  translate  and  orient  a  part  in  a  variety  of  ways 
under  program  controL  The  functionality  of  the  woric  bench  can  be,  for  instance,  ^plied  to  the 
chip-positioning  in  an  MCM;  the  advantage  is  that  the  assembly  job  can  be  operated  in  parallel  if 
weU  scheduled.  However,  an  opm  loop  control  scheme  does  not  keep  track  of  the  location  of  the 
part  placed  on  the  array  and  wUl  cause  difficulty  and  inefficient  operation  in  controlling  parts  for 
complicated  automatic  assembly  applications.  It  is  hard  to  predict  when  the  part  is  oriented  to  the 
destination  position,  and  whether  it  is  rotated  well  enough  fur  further  assembly  woric.  This 
difficulty  could  be  avoided  by  operator  intervention  in  a  manual-assist  mode  but  addition 
capability  may  be  needed  for  automatic  operation.  The  easiest  addition  may  be  to  add  a  sensory  to 
the  micro-robot  cell;  e.g.  a  strain  gauge  on  the  main  beam  or  a  photocell  on  the  base  of  each  ceU. 
The  sensor  would  detect  the  presence  of  a  part  in  contact  with  or  occluding  the  ceil  and  be  used  to 
allow  much  mote  flexible  control. 

The  work  here  has  assumed  that  each  cell  is  individually  controllable  in  mod  and  ditection.This 
puts  a  functionality,  power  and  area  burden  and  challenge  on  the  design  of  the  control  processor 
required  to  drive  each  individual  machine. 

The  main  issues  for  future  study  ate: 

a.  A  study  of  different  mechanical  structures  for  implonenting  the  unit  robots. 

b.  The  adjustment  of  the  dynamics  model  to  suit  the  operations  of  the  specific  unit  robots. 

c.  The  investigation  of  friction  effect  in  both  robot-to-part  and  part-to-part  contacts  requited  for 
automated  assembly  studies. 

d.  The  inspection  of  the  error  tolerance  in  the  micro  assembling  work. 

e.  The  design  of  an  array  control  language:  the  integrated  system  must  provide  a  simple  control 
language  and  the  cotie^nding  interpreter  or  compiler  for  loading  the  specific  area  of  motion 
of  a  ^;)ecific  pattern  of  gaits  in  order  to  support  the  programmability  of  the  array  and  its  use  in 
iq)plications. 
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f.  The  design  of  the  control  processor  residing  in  each  cell. 
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